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Abstract 

We propose several parametrization-free solutions to the problem of 
quantum state reduction control by means of continuous measurement 
and smooth quantum feedback. In particular, we design a feedback law 
for which almost global stochastic feedback stabilization can be proved 
analytically by means of Lyapunov techinques. This synthesis arises very 
naturally from the physics of the problem, as it relies on the variance 
associated with the quantum filtering process. 
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1 Introduction 

Experimental techniques in quantum optics permit nowadays to continuously 
monitor and modify the dynamics of a cloud of cold atoms confined in an optical 
cavity jj^. The knowledge of the system state can be described by a condi- 
tional dynamical equation, the so-called Stochastic Master Equation (SME), 
obtained from a suitable quantum system-field interaction model by means of 
non-commutatitive filtering theory |31l l7]. and based on monitoring the outgoing 
field from the cavity. The stochastic perturbation induced by the indirect mea- 
surement process produces an effective dynamical reduction model pp. In other 
words, it makes the system state converge to one of the maximal information, 
pure states for the system physical observable interacting with the field. 

If we have a second controllable field, acting as a time dependent Hamiltonian 
perturbation, then we can use the real-time estimate of the system state to 
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modify the state reduction process. One possible use of such a feedback control 
strategy can be choosing to which pure state of the monitoring observable the 
system will converge. Beside possible interest for quantum measurement theory, 
the overall strategy can then be seen as a technique for engineering quantum 
state preparation. 

From a control theoretic viewpoint, the problem is doubtless challenging. 
The SME is a nonlinear affinc in control matrix Stochastic Differential Equa- 
tion (SDE) living in the convex cone of positive semidefinite A'^-dimensional 
Hermitian matrices. In the particular case of perfect measurement efficiency 
and maximal information on the initial condition, a SME turns out to be equiv- 
alent to a Stochastic Schrodinger Equation (SSE), i.e. a vector- valued, norm- 
preserving diffusion in |S| . Influencing the open loop state reduction by 
means of the measurement is therefore a stochastic nonlinear feedback stabi- 
lization problem. Partial solutions to this problem were presented for example 
in for 2 level SSE and, in more general terms, in [2H| based on a (convex) 
numerical Lyapunov design. This last solution, however, suffers from scalability 
problems as the dimension of the system grows, since it is based on explicit 
parametrizations which grow with A^^ if is the dimension of the system. 

For nonlinear (vector) SDE, most of the results on state feedback stabiliza- 
tion are due to Florchinger (see also e.g. [HIEIISI for other possible 
approaches) and consists of extensions of Lyapunov-based techniques, like the 
Jurdjevic-Quinn condition, control Lyapunov function constructions, passivity- 
based methods and so on, to the stochastic case. 

For our SME, these systematic construction methods have a limited success, 
and allow only to attain local stabilization in the particular case of SSE. The 
feedback that achieves it is the simple linear feedback already used for determin- 
istic unitary feedback stabilization of quantum ensembles [S]. However, owing 
to the nature of the problem, local convergence results are of no practical inter- 
est. It is the structure of the problem itself that suggests how to improve the 
design: the state reduction encoded in the SME is "certified" by the variance 
of the continuous measurement process, a multiequilibrium Lyapunov-like func- 
tion (with N equilibria corresponding to the N eigenvectors of the observable 
being measured) which is also a Morse function and can be used to enlarge the 
region of attraction of the controller. We shall in particular discuss two nonlin- 
ear feedback laws induced by the use of the variance, both more effective than 
the linear controller. Both allow for simple explicit proofs of convergence: one 
corresponds to a closed loop stochastic generator which is a sum of squares, the 
other to the square of a sum. The former achieves almost global stabilization for 
the perfect efficiency case, but cannot cancel all invariant sets of the dynamics 
in the more general SME and thus suffers from similar problems as the linear 
controller. The latter instead corresponds to a feedback stabilization design for 
the SME which is almost global, up to the N —1 isolated repulsive critical points 
(the remaining — 1 eigenvectors of the measured observable) . This feedback 
strategy extends the idea of "symmetry breaking" enunciated in Indeed 
it works by using the uncontrollable part of the drift term to evade from the 
zero-control locus. We also show how the rate of convergence can be modified by 
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tuning opportunely a pair of gains corresponding to the relative weights given 
to the controlled and uncontrolled parts of the stochastic generator. 



2 Model formulation and background material 

We need to recall some basics of quantum mechanics, quantum filtering and 
stochastic stability theory we will use later on. For an excellent introductory 
exposition to the statistical description of quantum systems see e.g. More 
details can be found in e.g. and references therein. For the theory of 

stochastic stability, main references are 0] while for stochastic feedback 
stabilization we shall make use of the works of Florchinger ^1^2^]. Needless 
to say, the paper |28| presents similar control-theoretic perspective on most of 
the material mentioned below. 



2.1 Quantum finite dimensional systems 

In the standard statistical formulation of quantum mechanics |17l I26| . to each 
quantum system is associated an Hilbert space 7i, whose dimension depends 
essentially on the observable quantities we want to describe. In fact, physi- 
cal observables are modelled as self-adjoint operators in the Hilbert space, the 
set of possible outcomes they can assume being their spectrum. In what fol- 
lows, we will consider only observables with finite spectrum, thus represented as 
Hermitian matrices C G Herm acting on C^. 

Our knowledge of the system will be represented by a density matrix p be- 
longing to the convex set 

= {p = > s. t. tr(p) = 1}. 

The extremals of M are the one dimensional orthogonal projections. These are 
called pure states, and are equivalent to unit vectors in Tig up to an overall 
phase factor, by setting p = |'!/')('/'| = (V') We will use Dirac's notation for 
vectors: jV') € {4'] G Unit vectors in Ti will be thus called state vectors. 
The usual notations (V', 0) and {ip,C(j)) will be replaced by ('01'/'), (V'|C'|</'). 

Consider an observable C and its spectral decomposition C = c^Pi, where 
{Pi} is a spectral family of orthogonal projectors summing to the identity. As- 
sume one can perform an ideally instantaneous measurement of C. The proba- 
bility to obtain as an outcome is then given by 

p{ci) = tr(P,;p). 

Thus, a density matrix determines also the expectation value of an observable 

(C) - tripC). 

If Ci is the observed outcome, the conditioned density matrix is given by the 
Liiders-von Neumann postulate as 
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We will assume throughout the paper to work in measurement units such 
that h = 1, where H is the Plank constant divided by 27r. In absence of mea- 
surements, the time evolution of an isolated quantum system is driven by the 
Hamiltonian H, i.e., the energy observable, as specified by: 

Notice that the evolution of the unobserved system is deterministic, and, if 
p = \ip){ilj\ is pure, it is equivalent to the Scrodinger equation 




= -iH\iP). 



Beside of these basic postulates and definitions, to tackle our main problem we 
will need more sophisticated tools to deal with continuous-time measurement 
and subsequent state conditioning. 

2.2 Continuous Measurement and Filtering Equation 

For explicit derivations and more detailed discussions of the following topics, we 
refer to e.g. [H El l2Hi ■ 

In the description of a classical uncertain system, observable quantities are 
represented by real random variables defined on a suitable probability space 
(f2, 1],P). The state of the system, i.e., our knowledge about it, is subsumed 
in the probability measure P. The observables form a commutative algebra, 
L°°(f],E,P;R). 

The quantum setting presented in the previous section can be interpreted 
as a non commutative generalization of a classical, discrete probability space 
|21| . The need for non-commutativity emerges experimentally, motivating the 
standard axiomatic formulation of the theory and being essentially captured 
by the canonical commutation relations |26| . Briefly, quantum observables, or 
non commutative random variables, form a (generally non commutative) Von 
Neumann algebra A and events are represented by orthogonal projections £ G A 
in the algebra. A generalized probability measure on £ is needed to compute 
probabilities of events. 

The finite dimensional setting we are working in leads to a concrete repre- 
sentation of the above abstract notions. We can identify A with Herm, and 
the set of generalized probability densities with M, determining probabilities 
through p{E) = tr(p£;), E €£. 

One can then apply quantum filtering theory to obtain a conditional equa- 
tion on A for the dynamics [JJ. It essentially plays the role of the classical 
Kushner-Stratonovich equation. Thus assume we are continuously monitoring 
the observable C for the system of interest. In quantum optics, this can be 
accomplished e.g. for an angular momentum observable C by an homodyne de- 
tection experimental setup j31j^. Since the observed C is time-invariant, we are 

^In general, with homodyne detection one makes continuous-time measurements of gener- 
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conditioning the dynamics on the observation of a commuting quantum stochas- 
tic process, that leads to a dynamical equation driven by classical white noise 
(see e.g. 0). 

Let (r2,£,P) a (classical) probability space and {Wt,t S IR"*"} a standard 
R-valued Wiener process defined on this space. The homodyne detection mea- 
surement record can be written as the output of a stochastic dynamical system 
of the form: 

dYt = ^tTiptC)dt + dWu (2) 

where < r] < 1 represents the efficiency of the measurement. Denote with £t 
the filtration associated to {Wt,t e M"*"}. 

Then one can derive the filtering equation determining the conditional evo- 
lution of the state for the measurement record the Quantum Filtering or 
Stochastic Master Equation (SME) a la Ito: 

dpt = {T{H,pt)+V{C,pt))dt + g{C,pt)dWt 

= (-i[H, pt] + pCptC - ^{C^pt + ptC^)) dt + ^{Cpt + ptC - 2tYiCpt)pt)dWt, 

(3) 

where represent the Hamiltonian part, with H given by a drift and a (bilinear) 
control part H = Ha + uHb, V and Q are the drift and diffusion parts of the 
weak measurement performed along the observable C = C^. The parameter 
p > Q represents the strength of the measurement. 

Here pt, the Al-valued solution of l|2Jl given a constant initial condition pq, 
that can be written explicitly as 

Pt = $(po,i,0), poC^M 

= Po+ f {T{H,Ps)+V{C,ps))ds+ f g{C,ps)dWs, 
Jo Jo 

exists, is unique, adapted to the filtration £t and A^-invariant by construction, 
see I3EH1 

Considering ||5J) and Q together, one can recognize the basic structure of 
a Kalman-Bucy filter. Since (C)t = tr(Cpt) is the expectation of Yt at time 
t, in Q dWt plays the role of innovation process in a filtering model. Other 
correspondences with the classical setting have been discussed and highlighted 
in e.g. 123. 

We denote by £ the infinitesimal generator a la Ito associated with the SME 

alized operators of the form: 

n[p] = Lp + pL'^, 

measuring the outgoing field from an optical cavity where we confine the system. The operator 
L depends on the system-field interaction occurring in the cavity. We will specialize to the 
case of Hermitian operators L = = C. 
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((2Jl, written in a "symmetrized" fashion 

l^- = \ ({^{H, Pt) + V{C, pt))^ + ^{T{H, pt) + V{C, ptj) 

2 2 (4) 

+s'ic,Pt))^ + ^g'{c,p,))y 

Consider now the case of perfect detection efficiency 77 = 1. In this case, 
a pure po remains pure throughout the evolution. In fact, recalling that pt = 
\ipt){ipt\ if and only if tr(/9j) = 1, it suffices to prove the following. 

Lemma 1 Consider (|2J) with pt a pure state and ry = 1. Then dtr(p^) = 0. 

Proof. Using Ito's rule, wc have: 

dtr(p2) = tii2ptdpt + {dptf) 

= tr {2pt {T + V)dt + 2ptgdW) + tr {g'^dt) 

= ptr (^2pt (^CptC - ^C^pt - IptC^^ ^dt + M77tr (((Cp* + ptC - 2{C)t)pt f) dt 
+ i^tr {{C ~ {C)t)pf) dWt 

= ptr (2(1 + ri)ptCptC - 2(1 - i^)C^ pj + y^{C)lp1 - ^ii{C)tpl) dt 
+ 4V7^tr((C-(C)t)p?) dWt. 



If ?7 = 1 the term p^ disappears and 

tr {2pt{T + V)+ g^) = ptT{ACptCpt + ^{C)\p\ - %{C)tp\) 
= Vtrf((C-(C)t)pt)'^ 



(5) 



The assumption of starting with a pure state pt = \'ijjt){ipt \ implies for example 
pI = pu tr(p2) 1 and iviptCptC) = {MC\ipt) {ipt\C\iPt) = {C)l Hence 

Vtr (((C - {C)t)ptf) = iptiiCptCpt - 2{C)tCp', + {C)IpI) 

= Ap{{Cf,-2{C)MCpt) + {C)l) (6) 
= 

and, likewise, 

tr((C-(C),)p?)=0 (7) 

□ 

Thus, the SME Q becomes equivalent to a Stochastic Schrodinger Equation 
(SSE) of the form 0: 

dWt) = [-iH - ^{C - \tl^t)dt + ^{C ~ {C)tMt)dWt. (8) 
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In particular (see [H] for details), the state space in this case, call it 5, reduces 
to a homogeneous space of the Lie group U{N): 

S = U{N)/{U{N - 1) X [/(!)) C M, 

of dim(5) =N^ -N. 

Equations of the form ||SJ) have been proposed as extensions to standard 
quantum mechanics in order to give a dynamical model for the after measure- 
ment "state collapse", i.e. postulate Q (see e.g. P and references therein). 

2.3 Elements of stochastic stability 

Consider pd an equihbrium solution of (Q, i.e. pd G M: !F{H,pd) +T>{C,pd) = 

gic\pd) = o. 

Definition 1 The equilibrium pd of the SME Q is said to he 

1. stable in probability if for any s ^ and e ^ 

lim P(sup|$(po,t,s)-pd| > e) = 0; (9) 

PO^Pd 

2. locally asymptotically stable in probability if ^ holds and 

lim Pf lim |$(po,i,s)-pd| =0) = 1; (10) 

Po^Pd \t^oo / 

3. almost globally asymptotically stable in probability if Q holds and pU|l 
is true \/ po G A4 except for at most a finite number of isolated points of 
M; 

4-. globally asymptotically stable in probability if Q holds and 

Pflim mpo,t,s)-pd\^0) =1. (11) 

Wc shall make use of the following Lyapunov conditions. 

Theorem 1 Denote by Bm the intersection of an open neighborhood B G Herm 
with the set of density operators: Bm ^ B C] M. Assume 3 a M-valued V G 
C^iBM, K) withV{pd) ^Q, V{BM^{Pd}) >0 and such that CVt = CV{pt) <0 
( resp. CVt < 0) y Pt G Bm \ {Pd}- Then pd is locally stable (resp. locally 
asymptotically stable) in probability. 

Since ij^l is invariant in M, the restriction of a full neighborhood to Bm is 
not altering the standard proof of this result (reported for example in |I9j). 

Just like in the deterministic well-established version of the LaSalle's 

invariance principle provides the w-limit set of a stable stochastic process. 
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Theorem 2 (JWjl) If 3 a Lyapunov function V S C^iM, M) such that CVt < 
V pt £ A^, i/ie?T. i/ie solution pt of Q tends with probability 1 to the largest 
invariant set whose support is contained in Af — {pt <E M. s. t. CVt = V t ^ 



Since we have the semiclassical approximation !F{H, pt) = —i[Ha + uHt, pt] 
with u a control function, the SME ||2Jl belongs to the class of stochastic affine 
in control nonlinear differential systems, for which a number of stabilizability 
conditions have been developed ^2 ^1 ■ ^^^^ ^^^'^ infinitesimal generator 
of the uncontrolled part of the dynamics 



Definition 2 The SME Q satisfies a stochastic Lyapunov condition at pd 
if 3 Bm C M and a Lyapunov function V ^ C'^ {Bm ■, R) such that for all 
Pt € Bm \ {Pd\ for which the Lie derivative CbVt = it is CoVt < 0. The 
stochastic Lyapunov condition is almost global if Bm is all of M. except for at 
most a finite number of isolated points. 

When this condition is fulfilled, V is said to be a stochastic control Lyapunov 
function for ©. Our feedback synthesis relies on this condition, but does not 
follow any of the standard constructions for control Lyapunov functions |12| . 

We shall instead make use of the following Jurjevic-Quinn type of stochastic 
stabilizability condition (see ^21 Def. 3.5 and ^I] Def. 3.1). 

Tlieorem 3 Assume 3 Bm C M, pd e Bm and V e C'^{Bm^ y{Pd) = 0, 
V{Bm \ {Pd\) > 0, such that 

1. CVt ptG Bm; 

2. the set {pteBM s. t. C^^Vt = C^CbV = 0, r e N} = {pd}- 

Then the feedback Ut = —CtVt renders the equilibrium solution pd locally asymp- 
totically stable in probability. 

All definitions and theorems carry on unchanged when A4 and Q are replaced 
by S and (©. 

3 Continuous state reduction: the feedback sta- 
bilization problem 

The problem we will discuss and solve can be stated as follows. 



0}. 



Co = C - Cbu, 



where 
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Problem 1 Find a smooth control law u{t) that (almost) globally stabilizes in 
probability the pure state pd — of an N -dimensional quantum system, 

whose dynamic is described by the filtering equation ^ conditioned by the con- 
tinuous observation of an observable C . 

We shall propose several choices of u{t) as linear and nonlinear feedback 
laws based on the conditional estimate for the state pt at time t. In the physics 
literature, this approach has been baptized bayesian feedback |30| and of course 
requires the real time integration of Q. Since u{t) ~ ut is smooth and adapted 
to the filtration f(, the closed loop solution exists and is unique in a global sense. 

The first feedback law proposed (§ is linear and allows to achieve only 
local stabilizzability for the SSE fS l3.2|l . If we choose a Lyapunov function that 
includes the variance of the measurement then two modifications of the 

linear law are easily identifiable and are presented in § 13.41 and § 13.51 The first 
one yields almost global asymptotic stability but only for the SSE, while with 
the second one we achieve almost global asymptotic stability in M. for the SME. 
The relation between rate of convergence and gain tuning for the latter feedback 
is discussed in § 13.61 

Let us first make suitable assumptions on J- and C. In order for \ipd) to be an 
equilibrium, assume \il)d) is an eigenstate of Ha and of C. To avoid unnecessary 
complications, assume further that the spectrum of C is non-degenerate and 
that [i?a, C] = 0. With this choice, it is always possible for example to fix a 
basis such that pd = |V'(i)(V'd| is diagonal and so are the free Hamiltonian Ha 
and C . We want to choose u so that pd is rendered an attractor for the SME. 
Since the spectrum of C is non-degenerate, 3 N — 1 state vectors other than 
l^d), IV'j), j = 1, . . . , iV— 1, that are eigenstates of C. When C is diagonal, they 
correspond to diagonal density matrices pj = '^ith diagonal elements 

{1, 0, . . . , 0}. Following the terminology of [H], we shall call these antipodal states 
of Pd- Denote with J the union of such antipodal points: J = Uj!ji^{IV'j)('0il}- 
Finally, to avoid trivial cases, assume that Graph(iJb) is connected, i.e., that all 
transitions between energy levels are enabled by the control field. 



3.1 A linear feedback controller 

A natural choice for a Lyapunov function is the distance between density oper- 
ators induced by the Hilbert-Schmidt norm |24) : 

=tr(p2)_tr(prfp). (12) 

One clearly sees that in the stochastic differential (0} the quadratic part can be 
neglected since Vi is linear in pt- 

LV^.t = -tr((-*[i7, pt\ + V{C, pt))pd) ^^^^ 
= -tT{-i[Hb, pt]pd)u = CbVi^tu. 

The non-Hamiltonian part vanishes because C and pd commute and the cyclic 
property of trace holds (see the proof of Proposition^: tr{—i[Ha, pt]pd) = 
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and 



tr [^(CptC - -{C^pt + ptC^)J Pdj = tr {{C^pt - C^Pt)pd) = 0. (14) 

Hence in the SME (j^J this stabihzation design is concerned only with the unitary 
part of the evolution and has the natural solution 

ut = ktT{-i[Hb, pt]pd), fc > 0. (15) 
Since the closed loop system has 

mj = -ktT\-i[Hh,Pt]pd)^0, 

one needs to study the w-limit set of Q with the feedback (|15|l . This is the 
difficult part of the linear feedback design (|15|l . We certainly have the following 
for the set of (pure or mixed) diagonal density operators, call it Q (often call 
eigenensemble |321)- 

Proposition 1 Consider the SME (|3Jl. For pt G Q, the state dynamics are not 
influenced by the feedback (|15|) . Moreover, Q is invariant. 

Proof. It suffices to notice that: 

tr{-i[Hb, pt]pd) = Vpt such that [pt,Pd] = 0, (16) 

since 

tr{~i[Hb, Pt]pd) = tT{~i[Hb, PtPd]) = 0, 

as any commutator under the trace operation. Similarly, [pt,C] — [ptjC^] = 0. 
Thus, the only term affecting the dynamics is the diffusion term, which is also 
diagonal. Hence the diagonal set is invariant. □ 

Since Q is a convex set, we have the following. 

Corollary 1 For the system ^ with the feedback H15|l $ open neighborhoods 
B G Herm such that pd is locally asymptotically stable in probability in Bm = 
BC^M. 

In fact, the dynamics confined to Q is only a fluctuation and since the 
probability of collapse to the eigenstate pa = G ^7 is equal to Pp^ = 

tr(/9ap), it is never 1 if p G Q \ 

3.2 Local stabilization of a class of Stochastic Schrodinger 
equations 

Consider the case 77 = 1. As discussed in Section the SME Q is equivalent 
to the SSE © and the state space is S. From the transversality of S with 
respect to the set of diagonal Hermitian matrices (see Theorem E.2 of d]), the 
intersection of S with Q is just J ^ {pd}- 

For this relevant particular case, one can show the following. 
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Theorem 4 Assume rj = 1 and that the following Kalman-like rank condition 
is satisfied: 

rankH[ffb, pd], [A, -i[Hi,, Pd]l ■ ■ ■ , [A, ... , [A , ~i[Hi„ pa]] . . .]) ^ - N 

" V ' 

N'^ - N - 1 times 

(17) 

where A is either ^iHa or C . Then the feedback law (|15() renders the equilibrium 
solution of Q locally asymptotically stable in probability. 

Proof. In order to prove Theorem 01 we need a related deterministic result. 
Consider the deterministic unitary bilinear control system obtained from ^ in 
correspondence of C = 

p^ -i[Ha, p]~iu[Hb, p], P^S, (18) 

and its tangent linear system at pd 

p = -i[Ha, p]-iu[Hb, pd]. (19) 

Lemma 2 Assume Ha strongly regular. If (|19|l satisfies the Kalman rank con- 
dition (|17|l with A = —iHa, then pd is locally asymptotically stabilizable by 
means of the feedback (|15|l . 

Recall that A = A'' strongly regular means A nondcgenerate and with all tran- 
sition frequencies (i.e., all differences of eigenvalues) that are different. The 
proof of this Lemma is available in P] (see also |2S1)- It essentially relics on the 
Jurdjevic-Quinn condition |18| : starting from the identity 

u = tr(-i[i?b, p]pd) = 
= -tT{-i[Hb, pd]p) = 0, 

compute sufficiently many derivatives 

{^lftY{-i[Ha, -i[Hb, pd]]p) = (20a) 
{~l)M^i[Ha, -i[Ha, -i[Hb, pd]]]p) = (20b) 

(-l)'^+itr( -i[Ha, -i[Ha, -i[Hb, Pd]] . . .]p) = 0. (20c) 

r times 

The strong regularity condition of Ha guarantees that all the commutators in 
H20|l are linearly independent up to a number equal to dim(iS); i.e., H17|l holds 
with A = —iHa, implying the controllability of the linearization (|19f) and thus 
the local stabilizability of the original system H18() . Since 5 is a manifold (and 
not an Euclidean space like in ^Hl)i the condition is only local. 
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Turning to the stochastic system @ and the stochastic Jurdjevic-Quinn con- 
dition of Theorem^ since we have a hnear Lyapunov function, when computing 
CoCbVi,t in lit = the quadratic part of Co docs not appear: 

CoCbVi,t = tri-t[Hh,nHa,Pt)+ViC,pt)]pd) 

= tl-i~l[Hb, -i[Ha, Pt]]Pd)+tr -|[C, [C\ pt]]]pd) 

= {-l)hr {-i[Ha, -i[Hk, PdWpt) + (-l)3tr(-|[C, [C, pd\]]pt) ■ 



(21) 



Similarly, 

ClCbVi^t =(-l)3tr(-^[i^„ -i[Ha, Pd\]]pt) 

+ i-l)Hr (^-i[Ha, [C, -t[Hb, pd]]]]pt) 



(22) 



+ (-l)^tr (-^[C, [C, -i[Ha, -t[Ht, pd]]]]pt 
+ {-Iftr [C, -|[C, [C, pdm]pt 

and so on for C^CbVi^t, r > 2. Hence, in the case of Ha strongly regular the 
stochastic Jurdjevic-Quinn condition holds whenever Lemma El holds, as the 
Lie algebra spanned by the commutators in C^CbVi = is at least as large as 
the one spanned by the commutators appearing in the deterministic conditions 
= ^. However, even when Ha not strongly regular but C is, the stochastic 
Jurdjevic-Quinn condition still holds as the terms 

[C, ...,-^[C, [C, ~^[Hb,pd]]]...]] 

still provide the needed linearly independent commutators (see for explicit 
recursive computations of the commutators involved). Since this is implied by 
(|17|) . the proof is completed. The condition is local just like its deterministic 
counterpart. □ 

■^Notice that since Vi is linear, in Theorem|l]we are only concerned with the linear part of 
the infinitesimal generators and this allows to infer the stochastic Jurdjevic-Quinn condition 
directly in terms of the Lie algebra, just like in its deterministic counterpart. Redoing the 
computations above for the corresponding Stratonovich equation (for which Lie algebraic 
conditions can be made fully rigorous for any Vi) 

dpt = {r{H, pt) + v{c, pt) - ^Gsic, pt))dt + g{c, pt) o dWt, 

where the quadratic term in the drift, Qs{C,pt), is (in the case C is traceless) 

G (r n fair n ^ dg{C,pt) , 
ys{c,pt) - - yy(c,pt) — — 1 — — y{c,pt, 

= pn {2CptC + c^pt + ptC^ - MC}t{Cpt + ptC) + i{c)lpt) , 

one arrives at the same conclusion. 
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Notice that the feedback law p5|) rewritten for the SSE ||HJ) is 

ut ^ ktT{~i[Hf„ \A){M\^d){M) 

= -ik{{^PM{1pd\Hb\iJt) - {AHdriHHtli^t)*) (23) 
= -2Mni((^t|Vd)(^d|if6|^t». 

Remark: Assume, without loss of generality, that pd = diag{l, 0, . . . , 0}. 
Then in order for lfT7|l to hold it must be {Hb)ij = (i?b)|i ^ 0, i.e., the control 
Hamiltonian Hi, must "enable" all transitions from \ipd) to all other eigenstates 
|i^,),j = l,...,7V-l. 

When ?7 < 1, the structure of the state space is larger than S and in particular 
the transversality of the state space with respect to Q no longer holds, hence 
Theorem 0] does not apply. 

3.3 A variance-based Lyapunov condition 

The feedback (|15() is the same linear controller used in [3] to study the deter- 
ministic stabilization problem with state feedback (corresponding to C = 0). 
In that setting, its region of attraction does not correspond to the entire state 
space. In our stochastic problem, there is the additional requirement that the 
w-limit set has to be invariant also to the flow of the diffusion part. We will ex- 
ploit this feature, considering, instead of Vi, the following candidate Lyapunov 
function: 

V = Vi+V2= tr(p2) _ tiipdp) + tr{C^p) - tr^Cp). (24) 

Clearly V ^ , V = only in p — pd- The function V2 in (|24|l is the variance 
of the filtering process along C: 

V2 = {C'-) - {Cy-. (25) 

V2 has the property of being a positive semidefinite Morse function on A4, i.e., a 
function whose critical points are nondegenerate |16j and can be used to attain 
a stochastic Lyapunov condition. 

Theorem 5 The system ^ satisfies an almost global stochastic Lyapunov con- 
dition with respect to the Lyapunov function V given in (|24|l . The only points for 
which the stochastic Lyapunov condition is not satisfied are the N — 1 antipodal 
states of Pd ■ 

Proof. To discuss the asymptotic properties of V2, it is useful to notice first 
that, using [H, C] ~ 0, the cyclic property of the trace and Ito's rule: 

d{C)t = tr{Cdpt) 

= tr{-i[H, pt]C)dt + 2^tr{C{C - {C)t)pt)dWt 
= utv{~i[Hb, pt]C)dt + 2Vw(tr(CV*) - {C)^t))dWt 
= utr{-i[Hb, pt]C)dt + 2^V2,tdWt. 
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Thus, for the system © we have: 

dV2,t = d{C^)t - 2{C)td{C)t - {d{C)tf 

= {ir{-z[H, pt]{C^ - nC)tC)) - AfivV^dt 

+ 2Vw(tr(CVt - {C)tC^pt) - 2tTi{C)tC^pt) + 2{C)^)dWt 

^ {u tr(-i[ifb, pt]{C^ - 2{C)tC)) - ApT^Vit)dt + 2^a{C,pt)dWt, 

(27) 

with cr(C, pt) = (C3)t - 3{C)t{C^)t + 2(C)3 the 3rd central moment. 
From H24|l . (|27|l and (|13() . the stochastic differential a la Ito for V is 

CVt = -tr{~t[Hi„pt]{pd + 2{C)tC-C^))u-ApTj{(C^)t^ {C)^t)y . (28) 

Considering the zero-control behavior, notice that if V2,t = the system state 
must be in an eigenstate of C and hence a{C, pt) — 0. Thus V2,t = is stationary 
for H27|l . The convergence to the eigenstates follows applying Theorcm^to any 
bounded right interval of zero containing V2.0 7^ 0. In fact, 

proves the convergence in probability of the variance to zero. Hence, for the 
closed loop system, looking at CqVi = CV2,t\^^^Q < everywhere, except 

at the A'' — 1 other eigenvalues of C and Definition |2l applies almost globally. □ 

3.4 Almost global stabilization of the SSE by nonlinear 
feedback 

Theorem 6 Assume j] = 1. The feedback law 

Ut^ktr{-t[Hi„ptKpd + 2{C)tC-C^)), k>0, (29) 

renders the equilibrium solution pd of the SSE JSJ almost globally asymptotically 
stable in probability, with region of attraction given by S \ J . 

Proof. The feedback (|29|l makes (|28f) into a negative semidefinite sum of 
squares: 

CVt = -ktr-'{-i[Hb,pt]{pd + 2{C)tC - C^)) - 4pTj {{C^)t - (C)?)' s$ 0. (30) 

Calling Afg the set of critical points of V: Afs = {pt G S s. t. CVt — 0}, from 
Theorem |5] we need to compute the w-limit set of the closed loop inside Afg- 
Since H3()|) is a sum of squares, Afs must be a subset of {pt G S s. t. 'CV2,t|^^g = 
0} = J^. Since in pa G J , pa ^ Pd, y{pa) > 0, pa cannot be asymptotically 
stable in probability. □ 

Remark: Notice that unlike Theorem^] Theorem|B|does not require any spe- 
cial structure for Hb (compare Remark following Theorem^)). In loose terms, one 
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could say that while the design of Theorem 0| relies on a controllable lineariza- 
tion, in Theorem 1^1 uncontrollable, asymptotically stable modes are allowed in 
the linearization. 

Of course, it can be easily shown that the feedback H29|l can be used also in 
place of (|15|l in Theorem^ 

3.5 Almost global stabilization of the SME by nonlinear 
feedback 

When ?/ ^ 1, Propositionnand CoroUarynstill hold also with the feedback (|29|) . 
Hence pt G Q is not attracted to pd with probability 1. Although simulation 
results seem to suggest that with both the feedback laws ((T^ and all non- 
diagonal density operators are attracted with probability 1 io pd, we do not see 
any clear way to prove it. The problem can however be solved in full generality 
by a different choice of feedback. 

Theorem 7 The system (|2J) with feedback law 

ut = tr{-i[Hb,pt]ipd + 2{C)tC-C^))-A^{{C^)t-{Cft) (31) 

admits pd as equilibrium solution which is almost globally asymptotically stable. 
The only states in M. which are not attracted in probability to pd are its N ~ 1 
antipodal states. 

Proof. 

Consider still the Lyapunov function V given in (|24|l . It is easy to see that 
the nonlinear feedback H31|l completes CVt in H28|l to a square: 

CVt - - {tii-t[Hb, pt]{pd + 2{C)tC - C^)) - 2^ {(C^)t - {Cf,)y < 0. 

Notice first that Pa G is a stationary point of both open and closed loop 
systems: CoV{pa) ~ CV{pa) = 0. We need to show that Af cannot belong to 
the w-limit set of the closed loop (with the exclusion of J') and that there is no 
subset oi M \ which can remain undriven for t oo. The crucial difference 
with respect to (|29|l is that l|3HI implies CqVi ^ ^Vt\u=o- From Theorem El 
the stochastic Lyapunov condition holds true and guarantees CoVt < almost 
globally. In particular, notice that CoVt < everywhere mAf\J', hence A/" \ J" 
cannot belong to the tj-limit set. In addition ittj^ = —2^/JIfjV2.t < 0, i.e., the 
set of spurious critical points is evaded also by means of the control action. The 
other claim follow by the similar observation that the zero-feedback locus 

U^iptGMs. t. tYi^tim, pt]{pd + 2{C)tC - C^)) = {{C^)t - (C)?)} 

is never invariant to CaVt outside J^. □ 

Remark: If the domain of attraction of (|31|l is \ J", the critical points 
of J are automatically repulsive equilibria of the closed loop system. If for 
some s ^ 0, ps G i/, then an arbitrarily small unitary open loop perturbation 
is enough to evade from J'. 
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3.6 Gain tuning and rate of convergence 



The performances of the feedback design can be improved by adding, and 
tuning appropriately, two different gains. Instead of consider the following 



ut = tr(-z[7?,, pt]{pa + {2{C)tC C')/f )) {{C'), (C)?) , (32) 

with fc > 0, ^ > 0. While k corresponds to the usual feedback gain, £ can be 
thought of as a rcscaling of the variance in the Lyapunov function (|24|l : 

The corresponding closed loop stochastic generator is then: 

r-Vt = (^ktT{-z[m,pt]{p, + {2{C)tC - C'))/f) - 2^ {{C')t - (C)?) 

(33) 

Proposition 2 The equilibrium solution pd of the system Q with the feedback 
law (I32|) is almost globally asymptotically stable for all k > and £ > 0. When 
£ ^ oo one recovers the linear feedback (|15|l . 

Proof. From (|33|l . for the closed loop system CVt < in A/" \ ^7, V fc > and V 
finite ^ > 0, as the proof of Theorem [T] still applies. The limit behavior follows 
by inspection of (|32|l . □ 

Notice that tuning £ docs not correspond to modulating the strength of the 
weak measurement p. 

The effect of £ is to change the influence of V2 on the closed loop dynamics. 
In terms of the Hilbert-Schmidt norm Vi, from (|13|l . its close loop differential 
is given by 

- eiT''{-i[Hb,pt]pd) - ^iT{-i[Hk,pt]{2{C)tC -C^))ii{-i[Hb,pt]pd) 
+ 4'^^tii-t[Hb,pt]pd)V2,t. 

Since only the first term is sign definite, convergence in probability to the target 
state V po G \ is guaranteed to be faster if we raise the gain £ (recall that 
V2 was introduced only to perturb the "symmetry" of the problem). 



4 Example: 2 level case 

For iV = 2, it is possible to give a simple pictorial description of the trajecto- 
ries of the system, provided one chooses a real parametrization, like the triple 
(a;, y, z) representing the Bloch vector: p = i(/2 + xa^ + yay + za^), with 
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Ox, CTy, (Tz the Pauli matrices. Consider the observable C = its eigenstate 
^ and the Hamihonian Ha = haCJzi = a^.- Since 



Pd 







-i[Ha, Pt] = hai-ytCTx + Xt(Jy), 

~i[Hb, pt] = -ztay+ytCTz, 
ViC, pt) = -p.{xt(Tx +yt(Jy), 
Q{C, Pt) = y/JIrj{~xtZtax - ytZtCTy + (1 - z^)az), 

the SME in terms of the Bloch vector is 

dxt = i~hayt - pxt)dt - y/JIrjxtZtdWt 

dyt = [haXt - uzt - pyt)dt - y/JI^ytZtdWt (34) 
dzt = uytdt - V7t?7(l - zf)dWt. 

The Lyapunov functions are 

1 



hence 



Vi^^il-z), V2 = l-z\ 



CVt^-yt[l-^\u-^{l~zt 



The feedback laws (fT5|) . and are, respectively, 

ut = kyt, (35) 
ut = kyt(^l-^^ , (36) 

Ut = fcytll-— I ^ — (l-^t), (37) 

for some k > 0, £ > 0. In correspondence of V and H36() . the closed loop 
infinitesimal generator is the sum of squares 

4:Zt\Y V'//-, „2^2 



while for H37() it is the square of a sum 



Looking at the closed loop dynamics, one sees that on the "line" of diagonal 
densities x = y = 0, for (|35|l and H36() the feedback is 0, the line itself is invariant 
and the dynamics driven only by the filtering term. This is no longer true for 
l|T7jl . as expected. 
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The level curves of (|38ll are visualized in Fig ^ for different choices of the 
parameters k, £. The figures shows that for £ that grows the locus CVt = 
tends to become aligned with the axis ?/ — 0. The effect of raising k instead is 
to increase the rate of convergence. 

For the feedback H37|) . in Fig. [21a few sample trajectories are plotted for 
different initial conditions (the boldface trajectory corresponds to po ~ h/'^, 
i.e., to the maximally mixed state). They are reproduced as xt, ?/t, zt versus 
time in Fig. |21 The corresponding time courses of ut, tr(p(), Vt and CVt are 
shown in Fig. ^ 

5 Conclusion 

It is well known in Control Theory that finding a Lyapunov function for nonlin- 
ear systems is more an art than a systematic science, and that the knowledge 
about the physical process can provide the intuition necessary for this scope. 
The present work is nothing but a confirm of both these rules of thumb. We 
consider (some of) the standard design procedures available for the class of 
stochastic differential equations we deal with and show how they provide only 
a partial solution to our stabilization problem. Once we integrate this design 
with some physical insight on the structure of the SDE, however, the feed- 
back synthesis becomes much more efficient and allows for a simple analytic 
demonstration regardless of the dimension of the system. In addition, since 
the Lyapunov function is a Morse function on the space of density operators, 
the feedback stabilization design guarantees global convergence up to a finite 
number of isolated and repulsive critical points. 
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Figure 2: A few trajectories of the closed loop system (|34|l - (|37|l ior fi = 1, 
77 = 1/2. The boldface trajectory corresponds to po = I2/2. 
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Figure 3: The same trajectories of Fig. El versus time. 
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Figure 4: Top left: control signal ut] top right: tr(/9(); bottom left Vt] bottom 
right: CVt- The trajectories are the same as in Figg. |2E1 
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